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ABSTRACT 

This document contains a number of processes and 
criteria levels with which the progressive test writer should be 
familiar in order to measure more than cognitive success* These 
processes allow test writers to examine existing paper and pencil 
examinations in order to sound out implications for performance 
testing. Hands-on performance testing is referred to as 
criterion-referenced testing (CRT) in the psychomotor or performance 
domain* This is one step beyond paper and pencil tests (PPT) which 
function mainly in the cognitive or knowledge domain and hardly ever 
at all in the performance domain of practical application. It should 
be sufficient for the typical test writer to work through these 
processes and criteria levels with two or three examples in order to 
derive maximum benefit. This experience will sharpen the purposes^ 
yardsticks, and repertories of experienced test writers enough to 
enable automatic application of these processes and criteria level 
without the necessity of constantly referring back to this procedures 
manual. This document is intended to help develop better hands-on 
performance evaluation instruments. (Author/DEP) 



* Documents acquired by ERIC include many informal unpublished * 
^ materials not available from other sources. ERIC makes every effort * 

* to obtain the best copy available. Nevertheless, items of marginal * 

* reproducibility are often encountered and this affects the quality * 

* of the microfiche and hardcopy reproductions ERIC makes available 

* via the ERIC Document Reproduction Service (EDRS)..EDRS is not * 

* responsible for the quality of the original document. Reproductions * 
« supplied by EDRS are the best that can be made from the original. * 
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ATTITUDE OBJECTIVE 



This material will help a teacher develop 

a format for psychomotor performance testing. 

The guidelines contained herein will help a 
teacher apply performance testing in a 
variety of settings. 

This material will draw out the best in a 
teacher's repertoire in a form that can be 
utilized elsewhere. 



INTRODUCTION 

This short document containj a number of processes and criteria 
levels with which the progressive test writer should be familiar in 
order to measure more than cognitive success. These processes allow 
te,^t writers to examine existing paper and pencil examinations in order 
to sound out implications for pei formance testing. Hands-on performances 
testing is referred to as criter:ion-referenced testing (CRT) in the 
psychomotor or performance domaii , Tliis is one step beyond paper and 
pencil tests (PPT) which function mainly in the cognitive or knowledge 
domain ana hardly ever at all in the performance domain of practical 
application. 

It should be sufficient for the typical test writer to work through 
these processes and criteria levels with two or three examples in order 
to derive maximum benefit. This experience will sharpen the purposes, 
yardsticks, and repertoires of experienced test writers enough to enable 
automatic application of these processes and criteria level without the 
necessity of constantly referrinj; back to this procedures manual. 

This document is intended to help develop better hands-on performance 
evaluation instruments. 

Ihe following page sunmarizes the path to CRT as herein presented. 
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The following nine procedures should be examined carefully in order to 
preview and overview the process of developing CRT items appropriate to 
**hands-on'' observation, testing, and evaluation in the performance or 
psychomotor domain. 
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PERFORMANCE (CRITERION-REFERENCED) TESTING '*HANDS-ON*' WORK SESSIONS 
(The Path from ContenL-Referenc id to Criterion-Reference) 

Performanc e 

1. Examine (a) sources such as ERIC microfiche. Armed Forces, 

State agencies, commercial outlets, and others 
where these performance tests may be found 
(b) examples of performance tests 

2. Analyze the format of typical performance tests 

3. Develop performance test items 

4. Evaluate test items already developed to see if these 

items meet performance test criteria 

5. Relate steps 1, 2, 3, and 4 abi>ve to self-paced 

learner progress 

6. Foresee specific difficulties :.n apply performance 

testing in the classroom and in the lab or shop 

7. Make sure criterion values are in line with 

course objectives 

8. Document learner success toward prespecified objectives 

9. Exchange successful practices with colleagues 

The above procedure performances should be kept in mind while reading, 
filling in, and discussing the following pages. The reason for writing 
responses is to provide a concrete basis for interaction with professional 
colleagues • 

Followup samples of how the above nine procedures have been used by occu- 
pational educators are available to individuals submitting original responses 
to the questions on the following pages. For maximum benefit, this sample 
followup material should be read only after an individual educator has gone 
through all nine procedures. This stress on independent responses is intended 
to stress creativity more than imitation. 



PERFORMANCE 1 



■PE ISPECTIVE- 



A. SUBJECT matter: 



Examples and sources o£ performance 
tests 



B. TASK 1: 



Fxamine (a) sources such as ERIC 
microfiche. Armed Forces, State 
agencies , commercial outlets , and 
others where these performance tests 
may be found; (b) examples of 
performance tests 



STEP 1: 



Identify one source of performance 
tests and obtain a sample. 



Which source was identified? 



STEP 2: 



Look at one example of a performance 
test. 



Which example was examined? 



STEP 3: 



Evaluate the usability of this 
performance test. 



How usable is it? 



STEP 4: 



Keep on repeating steps 1, 2, 3, above 
until a usable sample performance test 
is obtained. 
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PERFORMANCE 2 
-PERSPECTIVE- 



A. SUBJECT MATTER: Analysis of typical criterion-rcferGiiced 

test (CRT) 

B. TASK 2: Analyze the fortnat of typical 

per f ormanc e tests 



STEP 1: Pinpc int one test item for analysis. 

Reprcduce (or attach) the test item 
undei analysis : 



STEP 2: Analyze one test item to determine which 

objective (or criterion) is being 
evaluated. 



Whict criteria are specified? 



STEP 3: 



Verify the answer key, scoring directions 
or evaluation process. 



Reprcduce (or attach) the answer key, 
scoring directions, or evaluation process 
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PERFORMANCE 3 
— PEl SPECTIVE- 



A. SUBJECT MATTER: 

B. TASK 3: 



Development of C-R test items 
Develop performance test items 



STEP 1: 



Pinpoint an important course outcome. 
What is this important course outcome? 



STEP 2: 



Describe how success on this important 
course outcome is measured and by which 
yardsticks? 

Which yardsticks are used as criteria? 



STEP 3: 



Perform performance 2 on the above 
criteria and measuring instruments, 



NOTE: 



At this point, is is just as important to 
test out ideas as it is to write out 
practical suggestions. 
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PERFORMANCI 4 



PERSPECTIVE 



A. SUBJECT MATTER: 

B. TASK 4: 



Feedback and self-evaluation 

Eva h late test items already developed 
to s^e if these items meet performance 
test criteria 



grjngp I. Choo ie a format for CRT that is 

meaningful and relevant to local 
teac lers and learners. 

Describe this format in a few words; 



5;rgp 2: Justify the specific format selected. 

What is the most outstanding feature 
of the format chosen? 



STEP 3: Incorporate learner reactions to the 

f ornat. 

How was the final format improved through 
the use of learner recommendations? 
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PERFORMANCE 5 



PERS ?ECTIVE 



A. SUBJECT MATTER: Systems development 

B. TASK 5: Relate steps 1, 2, 3, and 4 to 

self-paced learner progress 



STEP 1: Measure productivity in terms of 

learner success and satisfaction. 

What should be looked for in trying 
to document learner achievement and 
learner growth? 



Reward all attempts at individual progress. 

When must individual gains scores, no 
matter how small, be given priority over 
productivity as measured by professional 
standards? 



STEP 3- 



Foster productivity standards among 
learners in realistic settings. 



When must productivity be stressed with 
successful, but slow achieving learners? 
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PERSPECTIVi;— - ' 

A* SUBJECT MATTER: Planning specifications 

B, TASK 6: Fore^^ee specific difficulties in 

appbring performance testing in the 
clasr.room and in the lab or shop. 



STEP 1: Measure the highest level of 

complexity upon which mastery is judged • 

What is the highest level of mastery 
in the test item under development? 



STEP 2: Set j£ a scale of benchmarks from the 

firsi: taste of mastery (for a beginner) 
to tie highest mastery (for experts). 

What is the first sign of success that 
can lormally be expected from a slow 
beginner? 



STEP 3: Sitn u Late the typical difficulties 

encountered by most learners befote 
achieving mastery • 

Whera do most learners lave difficulty. 
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PEtlFORMANCE 7 



A. SUBJECT MATTER: 

B. TASK 7: 



STEP 1: Define success. 

Write a short definition of success. 



PERSPECTIVE — - 

Areas for self-evaluation 

Make sure criterion values are in line with 
course objectives of learners 



STEP 2: Document successful learners in terms of 

non-cognitive achievements. 

What have the most su'^cessful learners done 
career-wise with acquired skills? 



STEP 3: Tie career o^^ectives together for learner 

consumption ai.d progress. 

What have ordinary, but successful learners 
done career-wise with acquired skills? 



STEP 4: Recognize success on all levels of competency. 

What have unsuccessful learners done career- 
wise with one or two skills acquired in this 
area? 
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PERFORMANCE 8 

PERSPECTIVE 

A. SUBJECT MATTER: Learner gains scores 

B, TASK 8: Document learner success toward prcspeciEied 

objectives 



STEP 1: Pinpoint prerequisites necess^^ry Zox learners 

before beginning attempts ^.t nascering a 
specific objective . 

What ^. the objective to be mastered? 



What are the prerequisites required of any 
beginner? 



STEP 2: Provide two or three alternatives for learners 

in need of remediation. 

What are some inexpensive and currently 
available forms of remediation? 



STEP 3: Evaluate the learner's transition from lack 

of necessary preparation to readiness for a 
prespecif ied objective. 

What are some simple evaluation tools that 
tell the difference between the prepared 
and unprepared learner? 
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A. SUBJECT MATTER: 

B. TASK 9: 



PERFORMANCE 9 

-PERSPECTIVE " 

Dissemination of practical techniques. 

Exchange successful practices with 
colleagues 



STEP 1: 



Stress the most important evaluation 
techniques for practical daily usage. 

What is the most important piece of 
advice that should be given to a teacher 
who is beginning to develop performance 
testing? 



Pinpoint one or two of the most urgent 
and unsolved problems that arise when 
dealing with performance evaluation. 

What is the most urgent and unsolved 
problem in dealing with performance 
testing? 



Pick u£ helpful suggestions from co-workers. 

What is a practical suggestion that has 
been encountered from colleagues during 
this working session? 
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